M2ICAL Analyses HC-Gammon
نویسندگان
چکیده
We analyse Pollack and Blair’s HC-Gammon backgammon program using a new technique that performs Monte Carlo simulations to derive a Markov Chain model for Imperfect Comparison ALgorithms, called the MICAL method, which models the behavior of the algorithm using a Markov chain, each of whose states represents a class of players of similar strength. The Markov chain transition matrix is populated using Monte Carlo simulations. Once generated, the matrix allows fairly accurate predictions of the expected solution quality, standard deviation and time to convergence of the algorithm. This allows us to make some observations on the validity of Pollack and Blair’s conclusions, and also shows the application of the MICAL method on a previously published work.
منابع مشابه
MICAL Analyses HC-Gammon
We analyse Pollack and Blair’s HC-Gammon backgammon program using a new technique that performs Monte Carlo simulations to derive a Markov Chain model for Imperfect Comparison ALgorithms, called the MICAL method, which models the behavior of the algorithm using a Markov chain, each of whose states represents a class of players of similar strength. The Markov chain transition matrix is populated...
متن کاملA scalable qubit architecture based on holes in quantum dot molecules
Sophia E. Economou, Juan I. Climente, Antonio Badolato, Allan S. Bracker, Daniel Gammon, and Matthew F. Doty Naval Research Laboratory, Washington, DC 20375 Dept. de Qúımica F́ısica i Anaĺıtica, Universitat Jaume I, 12080, Castelló, Spain Dept. of Physics and Astronomy, University of Rochester, Rochester, NY 14627 and Dept. of Materials Science and Engineering, University of Delaware, Newark, DE...
متن کاملFactors associated with Parkinson's disease patients with hyposmia in Chines e han population: a case-control study
Background: Hyposmia is important for early and differential diagnosis of Parkinson's Disease (PD); however its mechanism remains unclear. The aim of this retrospective study is to identify the clinical phenotypic associated with hyposmia in Chinese han PD patients. Methods: We used 16-item odor identification test from Sniffin’ Sticks (SS-16) to evaluate the olfactory function of 120 Chinese H...
متن کاملWhy did TD-Gammon Work?
Although TD-Gammon is one of the major successes in machine learning, it has not led to similar impressive breakthroughs in temporal difference learning for other applications or even other games. We were able to replicate some of the success of TD-Gammon, developing a competitive evaluation function on a 4000 parameter feed-forward neural network, without using back-propagation, reinforcement ...
متن کاملThe Study of Health Coaching: The Ithaca Coaching Project, Research Design, and Future Directions
Health coaching (HC) is a process holding tremendous potential as a complementary medical intervention to shape healthy behavior change and affect rates of chronic lifestyle diseases. Empirical knowledge of effectiveness for the HC process, however, is lacking. The purposes of this paper are to present the study protocol for the Ithaca Coaching Project while also addressing research design, met...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2007